Human-Powered Blocking in Entity Resolution: A Feasibility Study

نویسندگان

  • Weiling Li
  • Jongwuk Lee
  • Dongwon Lee
چکیده

Entity Resolution (ER) is the problem of matching the records that refer to the same entity within or across two or more data sources. In recent years, human-powered ER solutions have been proposed so that challenging ER tasks, that machines cannot do well, can be helped by human workers. While successful in achieving high matching accuracy, existing human-powered ER methods did not incorporate a core technique, i.e., blocking, for improving the scalability of the ER process. To address this issue, this paper carries out the feasibility study to validate whether the blocking technique can be integrated into the human-powered ER. Specifically, we first propose two variations of human-powered blocking methods. We then validate their effectiveness in improving the scalability of the ER process through simulated crowdsourcing and AMT-based experiments in synthetic and real-life datasets, respectively.

برای دانلود رایگان متن کامل این مقاله و بیش از 32 میلیون مقاله دیگر ابتدا ثبت نام کنید

ثبت نام

اگر عضو سایت هستید لطفا وارد حساب کاربری خود شوید

منابع مشابه

Feasibility Study of Building a Human Powered Hydrofoil Vessel

In this paper, a feasibility study of building a Human Powered Hydrofoil (HPH) vessel is reported. Hydrofoil vessels are a well-known class of high-speed crafts. In addition to high-speed operation, the hydrofoils have a reliable maneuvering capability, good stability and proper operation in waves. Also, a human powered vehicle, nowadays is an advancing idea. Different aspects of the design and...

متن کامل

Parallel meta-blocking for scaling entity resolution over big heterogeneous data

Entity resolution constitutes a crucial task for many applications, but has an inherently quadratic complexity. In order to enable entity resolution to scale to large volumes of data, blocking is typically employed: it clusters similar entities into (overlapping) blocks so that it suffices to perform comparisons only within each block. To further increase efficiency, Meta-blocking is being used...

متن کامل

Corpus based coreference resolution for Farsi text

"Coreference resolution" or "finding all expressions that refer to the same entity" in a text, is one of the important requirements in natural language processing. Two words are coreference when both refer to a single entity in the text or the real world. So the main task of coreference resolution systems is to identify terms that refer to a unique entity. A coreference resolution tool could be...

متن کامل

The Effect of Transitive Closure on the Calibration of Logistic Regression for Entity Resolution

This paper describes a series of experiments in using logistic regression machine learning as a method for entity resolution. From these experiments the authors concluded that when a supervised ML algorithm is trained to classify a pair of entity references as linked or not linked pair, the evaluation of the model’s performance should take into account the transitive closure of its pairwise lin...

متن کامل

Boosting the Efficiency of Large-Scale Entity Resolution with Enhanced Meta-Blocking

Entity Resolution constitutes a quadratic task that typically scales to large entity collections through blocking. The resulting blocks can be restructured by Meta-blocking to raise precision at a limited cost in recall. At the core of this procedure lies the blocking graph, where the nodes correspond to entities and the edges connect the comparable pairs. There are several configurations for M...

متن کامل

ذخیره در منابع من


  با ذخیره ی این منبع در منابع من، دسترسی به آن را برای استفاده های بعدی آسان تر کنید

عنوان ژورنال:

دوره   شماره 

صفحات  -

تاریخ انتشار 2014